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PEER  EVALUATIONS:  ARE  WOMEN  OFFICERS  RATED  DIFFERENTLY? 


BACKGROUND 

Peer ,  or  associate ,  ratings  have  a  long  tradition  of  use  In  the 
Armed  Forces  In  evaluating  leadership  potential  and  ability  (Stogdlll, 
1974),  notably  at  the  U. S.  Military  Academy  and  In  Officer  Candidate 
selection  and  evaluation.  The  basic  paradigm  In  this  type  of  rating  Is 
to  have  each  member  of  a  predefined  group  estimate  (by  rating,  ranking, 
or  nomination)  the  leadership  potential  of  every  other  group  member. 
However,  certain  factors  may  affect  the  validity  of  these  ratings.  One 
such  factor  Is  the  sex  of  the  rater  and/or  ratee.  Because  the  evaluation 
of  "leadership  ability"  Is  dependent  on  perceptual  experiences,  ratings 
may  be  Influenced  by  stereotyped  preconceptions  of  the  sex  role. 

The  change  to  an  all-volunteer  Army  has  raised  Issues  about  how  pro¬ 
jected  personnel  needs  will  be  met.  Although  women  have  been  In  the 
military  for  over  50  years,  their  Involvement  has  been  restricted  by 
quotas  on  the  number  of  women  recruited,  by  limits  on  the  military  occu¬ 
pational  specialties  <M0S)  available  to  women,  and  by  ceilings  on  the 
rank  women  officers  have  been  able  to  attain.  In  1974,  however.  It  was 
estimated  that  by  1979  the  number  of  enlisted  women  In  the  Army  %K>uld  be 
around  50,000,  four  times  the  1972  figure  (Vbster,  1974). 

Furthermore ,  since  combat  MOS  are  the  only  ones  not  open  to  women , 

434  of  the  total  482  Army  MOS  are  now  available  to  them.  Although  an 
Increase  In  the  number  of  women  helps  the  Army  maintain  qualitative  as 
well  as  quantitative  standards ,  certain  problems  are  Introduced  by  the 
growing  numbers  of  women.  The  Introduction  of  women  officers  Into 
employment  areas  historically  reserved  for  men  poses  special  problems. 

For  example ,  clashes  may  occur  between  expectations  of  appropriate 
behaviors  for  females  as  women  versus  appropriate  behaviors  for  females 
as  supervisors. 

Although  the  Influence  of  sex  on  peer  evaluations  has  not  been  In¬ 
vestigated  ,  previous  research  has  Indicated  that  peer  ratings  are  rela¬ 
tively  Insensitive  to  certain  other  situational  variables.  For  example, 
reliability  Is  maintained  even  though  peer  ratings  are  not  conducted  In 
a  face-to-face  situation  (Lewln ,  Dubno ,  and  Akula,  1971),  group  members 
have  known  each  other  for  only  short  periods  of  time  (Hollander,  1957), 
and  changes  are  made  In  the  composition  of  the  group  (Medland  and  Olans , 
1964).  Also,  though  peer  ratings  have  been  criticized  as  popularity 
contests,  friendship  does  not  drastically  affect  validity  coefficients 
(Hollander,  1956;  Horrocks  and  Wear,  1953;  Peterson,  Komorita,  and  Quay, 
1964;  Waters  and  Waters,  1970;  Wherry  and  Fryer,  1949). 

While  these  results  are  fairly  consistent,  care  must  be  taken  when 
generalizing  to  non-white  and/or  non-male  members  of  the  population. 

There  Is  some  evidence  to  suggest  that  the  race  of  the  rater /ratee  may 
have  significant  effects  on  soclometrlc  types  of  rating  procedures 
(e.g.  ,  Mann,  1958).  In  military  settings,  using  both  a  forced-choice 


rating  technique  (deJung  and  Kaplan,  1962)  and  a  complete  ranking 
procedure  (Cox  and  Krumboltz ,  1958),  raters  were  found  to  give  signifi¬ 
cantly  higher  ratings  to  individuals  of  their  own  race  than  to  those  of 
another  race«  This  effect  was  more  marked  for  black  than  for  white 
raters. 

On  the  other  hand,  when  a  forced  distribution  type  of  peer  rating 
was  administered  in  an  industrial  setting  (Schmidt  and  Johnson,  1973), 
racial  biases  were  not  found.  These  results  may  be  explained  by  the 
fact  that  in  this  case  the  ratings  were  obtained  Immediately  following 
a  human  relations  council ,  when  group  members  may  have  been  more  sensi¬ 
tive  to,  and  aware  of,  racial  issues. 

If  peer  ratings  are  sensitive  to  bias  from  racial  variables,  they 
may  also  be  sensitive  to  sex  variables.  While  there  is  no  direct 
evidence  to  this  effect ,  research  with  other  evaluative  procedures  has 
shown  biases  as  a  function  of  the  sex  of  the  rater  or  ratee.  For 
example,  leadership  style  is  affected  by  the  sex  of  the  leader  (Bartol , 
1974;  Bartol  and  Butterfield,  1974;  Megaree ,  1969).  Laboratory  work  in 
the  area  of  perceived  sex  differences  has  suggested  that  the  abilities 
and  performance  of  individuals  may  be  differentially  perceived  as  a 
function  of  their  sex  (Clark,  1974;  Deaux  and  Taynor ,  1973;  Goldberg, 
1968;  Pheterson,  Klesler ,  and  Goldberg,  1971;  Rosen  and  Jurdee ,  1973; 
Taynor  and  Deaux,  1973).  However,  when  research  was  moved  out  of  the 
college  laboratory  and  into  more  applied  areas,  no  differences  were  found 
in  perceived  leadership  effectiveness  as  a  function  of  the  sex  of 
either  the  percelver  or  the  perceived  (Day  and  Stogdill ,  1972;  Osborn 
and  Vicars,  1975).  Currently,  while  it  is  difficult  to  draw  any  conclu¬ 
sions  from  these  results,  it  seems  clear  that  sexual  biases  do  exist 
in  different  rating  situations. 

Conflict  between  Job  demands  and  traditional  sex-role  stereotypes 
may  have  an  impact  on  perceived  leadership  abilities;  this  conflict 
may  be  especially  significant  for  the  military.  Although  women  are 
now  playing  a  more  active  and  comprehensive  role  in  society  in  general , 
and  in  the  Army  in  particular ,  no  reported  research  was  found  on  the 
effect  of  sex  on  peer  ratings.  Because  this  rating  technique  is  being 
considered  for  expanded  use  as  an  assessment  tool  in  Army  officer 
school ,  study  of  the  interaction  of  sex  and  peer  ratings  was  needed. 

As  part  of  a  larger  research  effort,  a  preliminary  investigation 
was  conducted  to  find  trtiether  there  were  Indications  of  a  possible  sex 
bias  in  peer  ratings.  The  primary  objective  was  to  note  whether  dif¬ 
ferences  in  peer  ratings,  either  given  or  received,  occurred  as  a 
function  of  the  sex  of  the  officers  giving  and  receiving  the  ratings. 

The  secondary  objective,  should  varying  effects  of  sex  bias  be  found, 
was  to  Investigate  correlates  of  those  differences. 


METHOD 


SAMPLE 

Data  were  collected  on  10  female  and  30  male  newly  commissioned 
officers  attending  the  12-week  Adjutant  General  Officer  Basic  Course 
(OBC).  One  man  and  one  woman  were  first  lieutenants;  the  remaining 
officers  were  second  lieutenants. 


INSTRUMENTS 

Peer  ratings.  Associate  ratings  measure  leadership  potential. 

During  the  final  week  of  the  course,  each  member  of  the  class  nominated, 
in  alternating  fashion ,  six  fellow  members  considered  to  have  “the  most 
leadership  potential"  and  six  with  "the  least  leadership  potential."  A 
high  nomination  received  a  weight  of  3,  a  low  nomination  a  weight  of  1, 
and  no  nomination  a  weight  of  2.  Results  of  these  ratings  were  then 
summed  for  each  Individual ,  and  a  mean  score  was  obtained.  This  mean 
score  represents  a  person's  leadership  potential  as  judged  by  other 
members  of  the  group.  Complete  Instructions  are  given  In  the  Manual  for 
Administration  of  Officer  Basic  Course  (OBC)  Associate  Ratings  (PT  4949), 
the  U.  S.  Army  Standard  Rating  Form  (PT  4839),  and  the  Guide  for  Coding 
the  U. S.  Army  Standard  Rating  Form  (PT  4885)  (see  Appendix  A). 

Achievement  and  attitude  measures.  The  Officer  Evaluation  Battery 
(OEB)  ,  a  series  of  tests  designed  as  a  diagnostic  measure  of  leadership 
and  career  potential ,  was  administered  to  the  students  during  the  first 
week  of  the  course.  The  OEB  was  developed  by  the  Army  Research  Institute 
for  the  Behavioral  and  Social  Sciences  (Helme,  1968;  Helme,  ttlllemln, 
and  Grafton,  1974).  The  battery  was  standardized  on  an  all-male  sample 
and  has  been  found  to  be  predictive  of  effective  leadership  In  the  field. 
The  OEB  Is  currently  being  standardized  on  mixed-sex  samples. 

The  seven  subtests  of  the  OEB  are: 

1.  Combat  Leadership  Cognitive  (CLC)  ,  composed  of  questions  relating 
to  practical  skills  and  military  tactics 

2.  Combat  Leadership  Non-Cognltlve  (CLN)  ,  emphasizing  physical 
activity  in  the  outdoors 

3.  Technical-Managerial  Cognitive  (TMC)  ,  which  is  a  composite  of 
two  kinds  of  Information,  math/science  and  hlstory/polltics/culture , 
and  which  correlates  highly  with  general  Intelligence 

4.  Technical-Managerial  Hon-Cognitlve  (TMH)  ,  which  tests  Interests 
and  proficiencies  In  math  and  the  sciences,  and  verbal-social  leadership 
qualities 

5.  Career  Potential  Cognitive  (CPC) ,  dealing  with  military  technology 
and  management 


6.  Career  Potential  Non-Cognitlve  (CPN) ,  which  measures  preference 
for  combat  over  administrative  jobs,  and  for  manual  and  physical  labor 
over  white  collar  work 

7.  Career  Intention  (Cl)  ,  which  directly  measures  Army  career 
Intentions. 

Final  class  grades ,  which  are  weighted  combinations  of  various  class¬ 
room  examinations,  were  also  collected. 


RATING  GROUPS 

Four  different  rater/ratee  groups  were  analyzed:  males  rating  males 
(MM);  males  rating  females  (MF);  females  rating  males  (FM) ;  and  females 
rating  females  (FF).  Vflth  these  four  rating  groups,  it  was  possible  to 
examine  both  the  sources  and  the  objects  of  bias.  The  method  used  for 
scoring  the  nominations  would  not  allow  a  significant  difference  between 
raters  but  would  allow  opportunity  for  either  a  ratee  or  Interaction 
term  to  be  significant.  A  statistically  significant  interaction  term 
would  be  suggestive  of  a  rating  bias.  A  significant  ratee  effect  could 
be  the  result  of  either  real  sex  differences  in  leadership  potential  or  a 
rating  bias  shared  by  both  sexes ,  or  both. 


RESULTS 

Table  I  presents  the  means ,  standard  deviations ,  and  t-tests  of 
differences  for  the  variables  for  men  and  women.  Men  scored  signifi¬ 
cantly  better  than  women  on  the  Combat  Leadership  Cognitive,  Career 
Potential  Cognitive ,  and  Combat  Leadership  Non-Cognltlve  scales.  Women 
scored  better  on  the  Career  Intention  scale.  No  differences  were 
found  on  the  remaining  three  scales. 

Table  2  presents  the  results  of  a  2  x  2  (sex  of  rater  by  sex  of 
ratee)  unweighted  means  analysis  of  variance  with  repeated  measures 
across  ratees.  Female  officers  were  rated  significantly  lower  by  both 
men  and  women  officers  that  were  their  male  counterparts  [F  (1,38)  ■ 

4.  61 ,  £  <  .05]. 

Table  3  presents  the  correlation  of  peer  rating  scores  with  OEB 
scale  scores  for  the  four  rater/ratee  groups  (Appendix  B  presents 
the  entire  Intercorrelation  matrix  for  men  and  women).  The  relation¬ 
ship  between  peer  ratings  and  general  achievement  as  signified  by 
score  on  the  Technical-Managerial  Cognitive  scale  was  significantly 
different  from  zero  for  females  rated  by  females.  Male  peer  evalua¬ 
tion  scores  received  by  men  and  women  were  significantly  related  to 
Combat  Leadership  Non-Cognltlve  scale  scores. 


Table  1 


VARIABLE  MEANS,  STANDARD  DEVIATIONS,  AND  T-TESTS 
OF  DIFFERENCES  FOR  MEN  AND  WHEN 


Raters 


Males  Females 

(N  -  30)  (N  -  10) 


Variables 

Mean 

S.D. 

Mean 

S.D. 

^-test 

Male  Raters — Peer 
Evaluations 

2. 05 

.27 

1.81 

.29 

• 

Female  Raters-- 
Peer  Evaluations 

2.  04 

.31 

1.  86 

.31 

• 

Combat  Leadership 

Cognitive 

99. 1 

24.6 

54.1 

12.0 

5.  53** 

Technical-Managerial 

Cognitive 

101.  7 

25.3 

95.7 

20.4 

.68 

Career  Potential  Cognitive 

99.4 

20.4 

78. 1 

22.0 

2.81* 

Combat  Leadership 

Non-Co gnltlve 

96. 1 

18.7 

76.0 

20. 1 

2.  89* 

Technical-Managerial 

Non-Cognltlve 

100.7 

21.4 

96.2 

15.6 

.61 

Career  Potential 
Non-Cognltlve 

85.9 

16.7 

83.6 

10.4 

.35 

Career  Intentions 

97.4 

17.7 

123.4 

9.5 

4.41** 

Final  Grade 

86.7 

3.7 

81.8 

5.2 

3.27* 

*  see  Table  2. 

*  p  <  .05 

**  p  <  .01 
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Table  2 

ANALYSIS  OF  VARIANCE  OF  SEX  OF  RATER  BY  SEX  OF  RATEE, 
PEER  EVALUATION  DIFFERENCES 


Source 

Sum  of  Squares 

df 

Mean  of  Squares 

Sex  of  Ratee 

6731.0 

1 

6731.0 

Error  Between 

55543.  2 

38 

1461.7 

Sex  of  Rater 

53.2 

1 

53.2 

Sex  of  Ratee  x  Rater 

136.  5 

1 

136.5 

Error  Within 

13561. 2 

38 

356.9 

*  p  <  .05 

•  F  <  1.00 


-  6  - 


Table  3 


CORRELATIONS  BETWEEN  PEER  EVALUATIONS  AND 
OEB  SUBTESTS  SCORES  FOR  MEN  AND  WOMEN 


Peer 

Evaluation 

Group 

OEB  Subtest 

Female 

Rater 

Male 

Rater 

Women 

Combat  Leadership  Cognitive 

.14 

-.07 

Technical-Managerial  Cognitive 

.66* 

.04 

Career  Potential  Cognitive 

.49 

.01 

Combat  Leadership  Non-Cognltlve 

.48 

.41 

Technical-Managerial  Non-Cognltlve 

.51 

.47 

Career  Potential  Non-Cognltlve 

-.  29 

-.  18 

Career  Intentions 

-.  03 

-.  38 

Final  Grade 

.57 

-.01 

Men 

Combat  Leadership  Cognitive 

.26 

.09 

Technical-Managerial  Cognitive 

.12 

-.  24 

Career  Potential  Cognitive 

.21 

.  13 

Combat  Leadership  Non-Cognltlve 

.38* 

.40* 

Technical-Managerial  Non-Cognltlve 

.26 

.  12 

Career  Potential  Non-Cognltlve 

-.  03 

.02 

Career  Intentions 

.13 

.24 

Final  Grade 

.14 

-.08 

The  six  possible  differences  between  correlations  were  treated  using 
two  methods.  For  tests  of  MM  vs  FM  and  FF  vs  MF,  Hotelling's  formula 
for  testing  differences  between  correleted  correlation  coefficients  was 
used.  All  other  tests  were  based  on  the,  formula,  for  uncorrelated  co¬ 
efficients  of  correlation  (Guilford,  1965). 

Table  4  presents  the  results  of  tests  between  correlated  correlation 
coefficients.  For  groups  MM  vs  FM,  only  the  coefficient  between  peer 
ratings  and  the  Technical-Managerial  Cognitive  scale  of  the  OEB  was 
significantly  different,  (p  <  .05).  VIbmen  rating  men  weighed  general 
Intelligence  more  heavily  In  evaluating  leadership  potential  than  did 
men  rating  men.  For  groups  FF  vs  again,  differences  were  found 
between  rating  groups  only  for  the  Technical-Managerial  Cognitive  scale. 
Women  weighed  general  Intelligence  factors  more  heavily  In  evaluating 
leadership  potential  (p  <  .05)  than  did  men,  whether  they  were  rating 
men  or  women. 


Table  4 

DIFFERENCES  IN  CORRELATED  CORRELATION  COEFFICIENTS 
BETWEEN  PEER  RATINGS  AND  OEB  SUBTESTS 


t-Value 

for  Difference 

OEB  Sub test 

MM  vs  FM 

FF  vs  MF 

Combat  Leadership  Cognitive 

-.  48 

.  70 

Technical-Managerial  Cognitive 

-2.  26* 

3.  71* 

Career  Potential  Cognitive 

-.47 

2.01 

Combat  Leadership  Non-Cognltlve 

.13 

.  26 

Technical-Managerial  Non-Cognltlve 

-.  83 

.  22 

Career  Potential  Non-Cognltlve 

.23 

-.  52 

Career  Intent 

.65 

1.  81 

Class  Standing 


-.  59 


1.  96 


Table  5  presents  the  results  of  testing  differences  for  uncorrelated 
correlation  coefficients  between  peer  ratings  and  OEB  scales  for  MM  vs 
MF ,  FF  vs  FM,  MF  vs  FM,  and  MM  vs  FF.  The  only  significant  difference 
was  found  with  the  Technical-Managerial  Cognitive  scale  idien  women  rated 
women  vs  men  rating  men.  Consistent  with  other  findings,  women  again 
weighed  Technlcal*41anagerlal  Cognitive  factors  more  heavily  than  men 
when  evaluating  leadership  potential. 


Table  5 

DIFFERENCES  IN  UNCORRELATED  CORRELATION 
COEFFICIENTS  BETWEEN  PEER  RATINGS  AND  OEB  SUBTESTS 


z-Value  for 

Difference 

OEB  Subtest 

MM  vs  MF 

FF  vs  FM 

MF  vs  FM 

MM  vs  FF 

Combat  Leadership  Cognitive 

.38 

-.29 

-.81 

-.  14 

Technical-Managerial 

Cognitive 

-.67 

1.  60 

-.  19 

-2.  45* 

Career  Potential  Cognitive 

.29 

.95 

-.  48 

-1.60 

Combat  Leadership  Non- 
Cognitlve 

-.  05 

.29 

.  10 

-.24 

Technical-Managerial 

Non-Co gnltive 

-1.07 

.69 

.57 

-1.05 

Career  Potential  Non- 
Cognltlve 

.48 

-.  64 

-.  36 

.76 

Career  Intent 

1.  52 

-.  38 

-1.  26 

.64 

Class  Standing 

-.  74 

1.31 

.31 

-1.  74 

DISCUSSION 

Preliminary  work  on  the  use  of  peer  ratings  as  a  performance  assess¬ 
ment  device  In  mixed-sex  officer  groups  Indicates  that  women  are  rated 
lower  by  both  males  and  females  on  leadership  potential  than  their  male 
colleagues.  They  also  scored  less  well  on  the  OEB.  The  present  effort 
was  unable  to  answer  the  question  of  whether  this  difference  In  per¬ 
ceived  leadership  ability  was  due  to  real  differences  or  to  bias. 
Conceivably ,  the  OEB ,  which  was  standardized  on  all-male  samples ,  may  be 
exhibiting  bias  also.^ 

Actual  differences  In  leadership  skill  may  exist,  perhaps  produced 
by  an  Interaction  of  such  factors  as  women's  tendency  to  refuse  to  assume 
leadership  over  men  (Megaree ,  1969)  or  that,  because  of  a  presumption  of 
Incompetence ,  women  may  be  given  fewer  opportunities  than  men  to  Influence 
groups  (Berger,  Cohen,  and  Zeldltch,  1972)  and  therefore  lack  leadership 
experience. 

On  the  other  hand,  low  "ascribed"  status  tends  to  handicap  Individ¬ 
uals  who  want  to  achieve  status  within  a  group  (Katz,  1970).  Being 
female  In  an  all-  or  nearly  all-male  group  could  be  considered  as  being 
of  low  ascribed  status.  Women  In  the  Army,  even  In  a  relatively  neutral 
sex-role  occupation  In  the  Adjutant  General  career  field,  may  thus 
operate  at  a  disadvantage  at  the  beginning  of  group  membership ,  since 
persons  of  low  ascribed  status  are  considered  to  have  low  competency 
until  proved  otherwise  (Wahrman  and  Pugh,  1974).  Thus,  women,  simply 
because  they  are  women ,  may  be  Initially  perceived  as  less  competent 
(Deaux,  1974;  Deaux  and  Emswlller ,  1974). 

Logically,  general  Intelligence  should  be  the  most  Important  factor 
for  success  as  an  administrator.  Men  and  women  scored  the  same  on  the 
Technical-Managerial  Cognitive  scale  of  the  OEB ,  the  scale  most  akin  to 
a  general  Intelligence  factor.  However ,  only  for  women  rating  women 
was  this  factor  significant  In  the  peer  ratings.  When  men  were  evaluated 
by  men  and  women ,  the  noncognltlve  aspects  of  combat  leadership  were 
emphasized ,  aspects  Irrelevant  to  administration  (Helme ,  ULllemln ,  and 
Grafton,  1971;  Helme  et  al.  ,  1974;  Mohr  and  Helme,  1975).  The  conflict 
between  expected  and  obtained  outcomes  suggests  that  bias  may  have  been 
operating. 

Since  any  army's  primary  mission  Is  combat.  It  may  be  that  "leader¬ 
ship"  was  Interpreted  as  "combat  leadership"  even  for  a  noncombat 
branch — and  combat  leadership ,  except  In  extreme  emergencies ,  has 
traditionally  been  seen  as  Inappropriate  for  women.  Correlation 
coefficients  In  Table  3  seem  to  support  this  Idea ,  since ,  for  both  men 
and  women,  combat  leadership  noncognltlve  activities  are  substantially 
related  to  peer  ratings. 

Further  and  more  comprehensive  Investigations  Into  the  potential 
problems  of  sex  bias  In  peer  ratings  are  needed.  If  the  peer  evaluation 
methodology  Is  at  fault,  specificity  In  the  form  of  differential  rating 
scales  could  be  added  to  the  currently  broadly  defined  dimensions  of 
leadership  potential.  If  sex  role  conflicts  produce  biased  judgments. 
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specificity  may  help  to  eliminate  the  source  of  these  conflicts.  If 
true  differences  exist ,  training  programs  might  reduce  these  differences. 
In  any  event ,  If  women  are  to  be  fairly  and  accurately  evaluated  In  the 
Army ,  caution  Is  called  for  prior  to  operational  use  of  peer  ratings 
as  a  personnel  assessment  device  for  women. 
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SECTION  I 


PREPARATION  FOR  RATINGS 


1.  PUrpow 

The  OBC  Associate  Ratings  are  designed  to  measure  the  OBC  stu¬ 
dent's  leadership  potential.  This  measure  is  obtained  by  having  each 
member  of  a  group  evaluate  his  fellow  members  and  nominate  those 
he  considers  to  have  high  leadership  potential  and  those  he  considers 
to  have  lower  leadership  potential.  These  results  are  then  compiled 
into  a  score  for  each  group  member  which  represents  his  leadership 
potential  as  judged  by  the  other  members  of  his  group. 

2.  General  Instructions 

a.  The  OBC  Associate  Ratings  are  to  be  administered  in  a  physi¬ 
cal  situation  which  assures  adequate  spacing  so  that  individual  privacy 
is  provided.  In  addition,  care  should  be  taken  in  the  collection  of  the 
completed  ratings  so  that  full  confidentiality  is  maintained.  The  ratine 
sessions  are  to  be  conducted  in  accordance  with  fte  instructions  given 
in  the  following  paragraphs  of  fliis  manxial  without  deviation.  Rating 
forms  were  developed  in  accordance  wifli  the  principles  of  test  construc¬ 
tion  set  forth  in  Chapter  10  "Ratings  as  Measures  of  Usefulness,"  in 
DA  Pamphlet  611-2,  Army  Personnel  Tests  and  Measurement.  The 
principles  of  administration  followed  are  from  chapter  1 1  "The  Admin¬ 
istration  of  Army  Tests"  in  the  same  reference.  Strict  adherence  to 
the  principles  is  required. 

b.  The  rating  session  is  not  a  timed  situation.  However,  it  is 

,  expected  that  each  rating  session  can  be  completed  in  twenty  minutes, 

including  seating,  distribution  of  materials,  rating  administration,  anti 
collection  of  completed  ratings. 

c.  Two  rating  sessions  are  to  be  conducted:  O’o  near  the  middle  of 
the  training  program  and  one  near  the  completion  of  training. 


3. 


Materials  Required 


a.  For  the  administrator.  The  materials  required  are; 

1.  A  copy  of  this  Manual  PT  4949 

2.  A  copy  of  the  OBC  Associate  Rating  Form,  PT  4839 

3.  A  copy  of  the  Guide  for  Coding  the  U.  S.  Army  Standard 
Rating  Form,  PT  4885 

4.  (Final  Rating  Session  Only).  A  copy  of  the  U.  S.  Army 
Associate  Rating  Questionnaire  (ARQ),  PT  4929 

5.  A  copy  of  the  Standard  Answer  Sheet,  DS  -1 120 

6.  Extra  #2  pencils 

b»  For  each  rater.  The  materials  required  are: 

1.  A  copy  of  the  OBC  Associate  Rating  Form,  PT  4839,  with 
the  rater's  group  roster  printed  thereon 

2.  A  copy  of  the  Guide  for  Coding  the  U.  S.  Army  Standard 
Rating  Form,  PT  4885 

3.  (Final  Rating  Session  Only).  A  copy  of  the  U.  S.  Army 
Associate  Rating  Questionnaire,  PT  4929 

4.  One  Standard  Answer  Sheet,  DS~1120 

5.  Two  #2  pencils 


SECTION  II 

CONDUCT  OF  THE  RATING  SESSION 


4.  Instructions-Ratings 

a.  The  instructions  which  are  indented  and  printed  in  larger  type 
are  to  be  read  aloud.  In  reading  the  instructions  aloud,  read  slowly 
and  distinctly,  making  sure  that  the  students  are  following  you. 


b.  When  the  students  are  seated,  say: 

We  are  now  going  to  distribute  the  materials  for  The 
Officer  Basic  Course  Associate  Ratings.  Do  ji^t  begin 
any  work  on  these  forms  until  you  are  told  to  proceed. 
When  you  do  begin  to  work  on  the  forms,  be  sure  to  use 
only  a  #2  pencil,  ^jigt  use  ballpoint  pens  or  fountain 
pens.  When  you  receive  your  forms,  check  the  name 
roster  on  the  Associate  Rating  Form  to  see  that  you  have 
the  correct  form  for  your _  (use  rating  group  name, 

i.  e.  platoon,  squad,  class,  etc.),  (pass  out  materials) 

The  Department  of  the  Army  is  conducting  research  on  the 
use  of  student  associate  ratings  as  an  additional  mea¬ 
sure  of  career  potential  of  the  individual  Army  officer. 
These  ratings  will  be  used  in  combination  with  other 
performance  evaluations  for  career  guidance  and  career 
development  purposes.  Rating  results  will  not  be  used 
to  replace  present  evaluation  such  as  OER'S  and  academic 
records,  but  will  be  used  as  additional  data  in  conjunc¬ 
tion  with  these  measures  for  more  accurate  and  refined 
apprasial. 

The _  (name  your  OBC  school)  School  is  partici¬ 

pating  in  this  research  program  through  conduct  of 
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associate  ratings  within  each _  _ (use  rating  group 

name).  These  ratings  are  for  research  purposes  and 
will  not  become  part  of  the  official  DA  Records.  These 
ratings  will  however  be  used  by  the  school. 

The  instructions  which  follow  are  phrased  in  terms  of 
operational  administration  and  the  results  obtained  will 
be  instrumental  in  a  later  policy  decision  on  adopting 
the  program.  Therefore,  you  should  complete  your 
ratings  in  accordance  with  these  instructions,  and 
conscientiously  follow  all  procedures  as  though  the 
results  were  to  be  used  operationally  by  the  Department 
of  the  Army. 

Now  take  your  "OBC  Associate  Rating  Form, ''  and  the 
"Guide  For  Coding  The  U.  S.  Army  Standard  Rating 
Form. "  Turn  the  rating  form  so  that  the  "Social 
Security  Number"  block  is  in  the  lower  right  hand  corner. 
Follow  the  instructions  in  Section  A  of  the  guide,  and 
example  given,  to  enter  and  code  your  own  social  security 

number.  (allow  time  for  this  coding) 

I  n  the  upper  right  hand  corner  "special  codes, "  enter 
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in  columns  1-4  the  class  number  and  fiscal  year.  This 
is  class  number  and  fiscal  year _  _ (Provide  nximbers, 

e.  g.  0174;  a  zero  is  to  be  entered  in  column  1  for  a  single 
digit  class  number. ) 

In  column  5,  enter  a  1  (one)  for  the  ratings  given  at 
mid-course  and  a  2  (two)  for  ratings  given  at  the  end  h 
of  the  course. 

I  n  column  6,  enter  your  military  status:  1  for  l^gular 
Army,  2  for  other  American  student,  and  3  for  Allied 
student.  ^ 

I n  column  7,  enter  a  zero.  # 

I  n  column  8,  enter  your  group  number.  See  the 
heading  on  the  Rating  Form. 

If  only  one  page  read: 

I  n  column  9  enter  a  zera 

If  two  pages  read: 

You  have  two  pages  of  ratings.  The  page  number  for 
the  sheet  is  identified  in  the  heading.  In  column  9 
enter  a  1  for  page  1  and  a  2  for  page  2. 

Now  code  these  numbers  in  the  same  manner  in  which 
you  have  coded  your  social  security  number. 


c.  Answer  any  questions,  and  permit  time  for  completion  of  the 
coding,  then  say: 

Now  look  at  the  roster  on  your  rating  form,  and  consid¬ 
ering  all  of  the  other  members  pick  the  one  officer  you 
consider  to  have  the  most  leadership  potential.  Base 
your  judgment  on  your  experiences  and  observations 
of  this  individual. 

Thon  in  the  rating  column  opposite  the  officers  name, 
blacken  in  the  space  under  "H, ''  number  7.  Refer 
^  section  B  on  your  Guide  for  Coding  for  an  example 
of  how  to  enter  your  rating. 

Now  identify  among  the  fellow-members  of  your  roster 
the  one  officer  you  consider  to  have  the  leadership 
potential.  Then  in  the  rating  column  opposite  his  name, 
blacken  the  space  under  "L,"  number  1. 

d.  Allow  time  for  raters  to  make  their  choices,  then  say: 

Now  continue  your  evaluations  among  th3  remaining 
members  of  the  roster,  selecting  first  your  next  choice 
for  most  and  then  your  next  choice  for  least,  (pause) 
Continue  in  this  manner,  alternating  your  high  and 
low  choices  until  you  have  marked  six  choices  for  most 
and  six  choices  for  least. 

NOTE:  If  rating  group  is  less  then  ^  change  number  of 
choices  to  4. 


-  26  - 


e.  Allow  time  for  completion  of  these  selections;  when  everyone 
has  finished,  say: 

Check  to  be  sure  that  you  have  rated  six  individuals  in 
the  "H"  column  and  six  individuals  in  the  "L"  column. 
Now,  for  all  of  the  remaining  names  on  the  list  which 
have  not  been  assigned  either  a  most,  "H, "  or  least, 

"L, "  blacken  In  the  "4"  space.  This  step  is  for  machine 
processing  accuracy  and  checking  only  and  will  not 
affect  the  ratings.  Turn  the  rating  form  over,  and  print 
and  sign  your  name  on  the  back. 


5.  Instructions-Questionnaire  (Final  Rating  Session  Only -C^ompletion  of  OBC  Questionnaire) 

P.'iss  out  the  Associate  Rating  Questionnaire  PT  4929. 

Then  say: 

You  have  completed  your  ratings,  now  take  the  Associate 
Rating  questionnaire.  Read  the  directions  and  fill  in 
the  information  as  instructed.  Answer  the  questions 
fully  and  frankly. 


6-  Disposition  of  Data 

a.  When  all  raters  have  completed  the  ratings,  arrange  for 
collection  of  all  rating  materials  prior  to  dismissal  of  the  class.  Be 
sure  that  tiiese  materials  are  collected  in  such  a  manner  that  privacy 
and  confidentiality  are  maintained,  then  dismiss  the  class. 


b.  The  collected  rating  forms  should  be  reviewed  by  the  rating 
administrator  as  soon  as  possible  after  completion  of  the  session  to 
check  that  the  coding  has  been  done  properly,  and  that  an  appropriate 
number  of  "H"  and  "L"  ratings  has  been  given.  In  case  of  obvious 
errors  or  discrepancies  in  the  ratings,  the  administrator  should 
contact  the  individual  rater  privately  to  resolve  errors  and  discrepancies, 
prior  to  release  of  the  rating  forms  for  AOP  processing. 
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GUIDE  FOR  COOING  THE  U.  S.  ARMY  STANDARD  RATING  FORM  <PT  ■  48391 


CODING  IDENTIFYING  INFORMATION 

Read  all  the  instructions  on  this  page  and  study  the  example.  Be  sure  that  you  understand  the 
instructions  thoroughly  before  completing  the  Social  Security  Number  (SSN)  block  on  your 
answer  sheet. 


KD 

©Next. 


first,  in  the  boxes  at  the  top  enter  the  digits  of  your  Social  Security  Number.  Omit 
hyphens  and  record  only  the  nine  digits  of  the  Number. 


Next,  after  entering  the  digits  of  your  Social  Security  Number  in  the  boxes  at  the  top. 
code  each  digit,  including  zeroes,  by  making  a  single  heavy  mark  in  the  appropriate 
number  space  for  each  column,  as  shown  in  the  example  below. 

EXAMPLE;  SSN:  515404953 


0 

1 

h 

161 

l:l 

I  ( 


) 

-  1  . 
^  I  ^ 


6  I  6 


f  I  « 

a  I  ^ 


?  I 


I  I 
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COOING  RATING  INFORMATION 
To  Code  MOST 

Identify  the  individual  you  want  to  code  as  MOST 

Then,  find  his  name  on  the  roster  and  code  the  "H"  block  in  the  "Rating"  column  to  the  right 
of  his  name. 


Sample 


1  NAME  1 

1  8AELOCK,  JAMES  ►  ^  • 

"  i 

►  1  /  1  S  1 

li 

FILL  IN  THIS 
ENTIRE.BLOCK 


To  Code  LEAST 

Identify  the  individual  you  want  to  code  as  LEAST 

Then  find  his  name  on  the  roster  and  code  the  "L"  block  in  the  "Rating"  column  to  the  right 
of  his  name. 


Sample 


[T 


RATINE 

imi 

1 

FILL  IN  THIS 
FNTIRE  BLOCK 


MARCUM.  ROBERT 


1^!.  » 


PT4885 


MAKE  NO  MARKS  ON  THIS  SHEET 
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APPENDIX  B  COfPLETE  INTERCORRELATION  MATRIXES 


Table  B-2 


